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ABSTRACT 


Scanning eye movements of airline pilots were recorded while 
they judged air traffic situations displayed on cockpit 
displays of traffic information (CDTI). The observed 1st ord- 
er transition patterns between points ot' interest on the 
display shoii^od reliable deviations from those patterns predict- 
ed by the assumption of statistical independence* However# 
both patterns of transitions correlated quite well with each 
other* Accordingly^ the assumption of independence provided a 
surprisingly good model of the results* Never the less# the 
deviation between the observed pattern^ of transition and t)iat 
based on the assumption of independence was for all subjects lu 
the direction of increased determinism* Thus# the results pro- 
vide objective evidence consistent with the existence of •’scan- 
paths" in the data* 


INTRODUCTION 

In the following experiment we examine the spatio-temporal 
structure of scanning eye movements made by airline pilots 
while viewing a cockpit display of traffic information (COTI) 
previously studied by Palmer# Jago# et* a^* (2# see also ref* 
6)* While viewing the displays, the pilots had to determine if 
intruding aircraft would pass in front or behind their ownship* 
In particular we wished to examine the opecific sequencing of 
fixations made with the goal of determining an information pro- 
cessing model of the in front/behind decisions the pilots made* 
Other aspects of the scanning will be discussed in future more 
detailed papers(sec ref S)* 


METHODS 

Display conditions 

A series of. 24 track-up CDTI displays was generated on a 
calligraphic computer graphics system in the manner of Palmer 
e t * a^* (2#3)* Each display depicted an encounter between two 

aircraft at the same altitude* (see insut of figure 2)* The 
miss distances for all encounters were set at 6000 feet while 
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ownship position was updated every 0*1 second and and the in- 
truder was updated every 4 seconds. Map range was set at 18.5 
km (10 nm). Each encounter consisted of 7 4-second updates; 2 
before the intruder appeared, and 5 afterwards. The display 
was blanked in such a way that after the last update, there 
remained 44 seconds before the ^ight paths of the aircraft 
crossed. After the display was blanked, the subject was 
promx^ted to decide if the intruder would pass in front or 
behind ownship. 

The encounters represented both straight and turning hor- 
izontal encounter geometries. Turn rate was constant at 1.5 
degrees/second. All aircraft had 32 seconds of previously 
tracked positions displayed as 8 dots of trail, one for each 
update, and had a 32 second predictor (see insert of figure 1 
for sample dx splay) 


Figure 1 



Two sets of itientical encounters were prepared; in one all air- 
craft had "straight" predictors which were Dcised on extrapola- 
tion of current ground speed, in the other "curved" predict<^r.s 
woie use(i which were based on current ground speed and turn 
r<4te. In addition to ownship and the intruder the display con- 
tained two -46 ogt aph i c a 1 locations (LOM and PEPSI) and a route 
shown as -t oolid line. All trajectories crossed near bOM, a 
fact neither pointed out to t):e subjects nor discovered by them 
during the course of the experiment. 

Direction of gaze data were recorded with a Gulf and 
Western 1994 pupil ome ter-based eye monitor which was calibrated 
by recording fixations at 25 reference points in a 5 X 5 array, 
14 degrees/side, centered in the subject's forward field of 
view. The display itself subtended a rectangle 12 by 10 de- 
grees at the viewing distance of 75 cm. The eye monitor output 
(x,y direction of gaze and pupil diameter), the subjects sig- 
nals, and the time markers from the videotape were all digital- 
ly recorded. The sample rate was 33 hz, the maximum allowable 
by the eye monitor . 


- 518 - 


t - • 




I 




Subjects 


Eight airline pilots were subjects in the experiment. All 
had had at least 3 hours experience in previous experiments us- 
ing similar CUTI displays and requiring similar in front behind 
judgements. All had at least average performance in these pre- 
vious studies . 


Procedure 

During an orientation session before each experiment/ the 
subjects were told that the purpose of the experiment was to 
dotetmine if pupilary changes could be used to predict their in 
front/behind judgements. Lengthly briefing was unnecessary due 
to their extensive familiarity with the CDTI prcjocc in general 
and the display format in particular; the meaning of all parts 
of the symbology was# however/ reviewed and each subject was 
given about 20 minutes practice making in front/behind judge- 
ments before their scanning patterns were recorded. After the 
initial practice/ the eye monitor was adjusted to track the 
left eye An initial 25 point calibration was taken by having 
the subject signal when he had fixated each of the reference 
points. The median X/y position taken during each of these 
fixations provided the basis for subsequent linear! r.ation and 
removal of cross-talk. Interspersed between data gathered dur- 
ing t)ie encounters were reset calibrations taken to correct for 
drift by having the subject refixate a position corresponding 
to the center of the calibration grid. A reset calibration 
was taken whenever t)\e signal was observed to drift more than 
about 1.0 degree. 


Data Processing 

After the experiment/ the data were transferred to a 
PIJ P-11/70 computer where it was linearized according to a 
pieoewise-linear approximation derived from the calibration 
fixations. ^'ixat ion locations were determined by passing a 
space-time window through the (iata and identifying fixations as 
those clusters of temporally contiguous datapoints representing 
at least 90 msec (3 samples) falling witliin a square region 
0.«2 de gr ee s { s i de , approximately the resolution of the eye mn^'- 
itv)r. If a cluster of data points potentially considered a 
fixation were interrupted by less than 90 msec of saturated 
values, they were considered as a single fixation. This pro- 
tected fixations from being interrupted by blinks. Longer 
interruptions resulted in their being considered as two 
separate fixations. 

After ivientifying the positions/ duration, and onset time 
of all fixations, the data were correlated with records of the 
positions of all noints of interest as a function of time after 
the beginning of* each encounter. Thus, each fixation could be 
assigned to one of eight possible points of interest; the end 
of f)wnship*8 trail (OST), ownship xjreaent position (OS), the 
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end of ownship's predictor (OSP), the end of intruder's trail 
(IT)^ intruder's current position (1) , the end of the 
intruder's predictor (IP), location PEPSI (PEP), and location 
LOM (LOM). (see figures 1 and 2) All fixations not within 2 
degrees of any of the above points of interest were assigned to 
the BIN. The data were then tabulated to determine overall 
distribution of fixation duration as well as separate distribu- 
tions for each point of interest. Per cent of time spent at 
each point of interest was determined. 


RESULTS 


The pilots distributed their fixational attention across 
the the eight points of interest in a highly stereotyped manner 
as indicated in figure 2. 

Figure 2 



POINTS OP INTPRPST 

Their distributions of attention reflect the differential use- 
fulness of the spatial information at tcich point of interest 
for the in front/behind judgement that they were required to 
make. Earlier studies of this particular display had shown, 
for example, that the presensc or absence of the trail haii no 
effect on accuracy of the pilots judgements, whereas the 
presense and type of predictor was very important (2). The 
higher proportion of viewing time on the location LOM probably 
occured because it was the point of intersection of the flight 
paths for all the encounters. 
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The differential probability of viewing the various points 
interest leads to a constraint on the scanning sequences 
mat could produce the impression of sequential scanning, name- 
ly that transitionfi between high probability points of interest 
are likely simply due to the zero order probability of viewing 
the respective points* Accordingly, any claim for the observa- 
tion of repetitive sequences in the the transition patterns 
among points of interest must first show that the extent of the 
"sequenciness" exceeds that which could be produced by the zero 
order probabilities* 

We have examined this possibility by using a method 
described by Senders et* a^, (4)* They note that the joint as- 

sumption of 1) statistical independence of the transitions and 
2) the existence of unobserved transitions from each point of 
interest to itself provides a means of calculating p(a to b), 
probability of a transition between any two points of interest, 
provided p(a), p(b), the zero order probabilities of the two 
points are known. 


p ( a ) p( b ) 

p(a to b) = 

. - ^r(i) 

We liave used these calculated probabilities to determine ex- 
pected frequencies of 1st order transitions between points of 
interest to compare with observed transition frequencies. T)iis 
comparison was made on a subject by subject basis with a chi- 
square goodness of fit test on the entire distribution of ob- 
served trajisitions witii tliat of expected transitions. The very 
low probability of viewing the end of the aircraft's trails, 
recuited, however, in very low expected frequencies for some of 
the tranjuitions. Thus, it was necessary to collapse seme of 
tlio transitions with expected frequencies less than 4.0 in ord- 
er to insure that not more than 20% of the terms in the cni- 
oquaro calculation had expected frequencies than 5. 
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to the very great statistical power of the test since the total 
number of transitions analyzed for each subject ranged between 
154 and 431* Furthermore; the test neither addresses the mag- 
nitude nor the direction of the deviation* 

Accordingly, in order to assess the extent of the devia- 
tion each subject *s expected transition f requenci*.? s were ploted 
against his corresponding observed frequencies# In a such a 
plot a perfect prediction corresponds to a linear regression 
with a slope of 1*0 and correlation of 1*0* As is clear from 
figure 3, the slope of the regressions for each subject are 
quite close to 1.0 (dashed line) and there is a strong linear 
relation between the observed and expected frequencies# 

Figure 3 

FFKOUENCIKS OF TRANSITION OTH OROFR MODFL 
(ALL SURJFCTR) 



ORSFRVKD FREQUENCIES 


Two correlations between observed and expected frequencies 
ire shown in table 1 for each sub*)ccL. Tht first is t>ie pearson 
correlation corresponiiing to the regressslons shown in fiaure 
3# The second is a peart^on correlation based on log transforms 
of both exppcteti'and observed frequencies which corrects for 
Uhe skew in tlie marginal distributions of observed and expected 
frequencies# 


- 522 - 



Though there exists a reliable deviation between the ob- 
served and expected frequencies, the independence model pro- 
vides a surprisingly good prediction of the actual 1st order 
transition pattern* However, the chi-square test comparing 
observed and expected transition frequencies provides no indi- 
cation of the direction of the deviation* The observed dis- 
tribution could, for example, be more rectangular than that 
predicted, i*e* the transition frequencies in any row of the 
1st order matrix are more equal to each other* Such a devia- 
tion would be in the direction of less determinism. Converse- 
ly, the observed distribution could be less even with higher 
peaks and lower valleys; such a deviation would be in the 
direction of more determinism* The most deterministic case be- 
ing that with only one type of transition occuring on each row 
of the 1st order matrix* 


We assessed the direction of the actual deviation on a 
subject by subject basis by treating each ith row of the 1st 
order transition matrix as a probability vector and calculating 
H(i), the ’•information” in bits contained in it. The total 
"information" in the matrix, H(matrix), was calculated as a 
weighted average of the rows where n(i), the total number of 
transitions in each row, providing the relative weights and 
p(i#j) was the probability of a transition to point j given a 
previous point of interest i. 


H (matrix ) 


n(i) 



p(i, j)log^ 
N 


P(i. j) 


] 


N *^n ( i ) * 


This measure of uncertainty when applied to each subject’s ob- 
served and expected transition matrices consistently indicated 
that the observed transition matrices were more deterministic 
than the expected matrices (two-tailed sign test p < .008)* 
thus establishing the direction of the statistically signifi- 
cant chi-square previously discussed. 


DISCUSSION 


The above results show that a surprisingly unstructured 
model of the transition pattern of fixational eye movements can 
provide an approximation of the actual pattern of transition 
^ among points of interest on a simple display. To the extent 

^ this approximation is correct the res ilts are consistent with 

t Senders visual sampling model. It predicts the number of looks 

I at a point of interest as a function of the bandpass of the 

signal presented there. (4). The collection of the eye move- 
ment data over an* extended period of time and across different 
display conditions, however, raises the possibility that the 
" data reflect the mixing of a variety of scanning strategies and 

that the transition pattern of the subjects was statistically 
nonstationary. This procedure would bias the results against 
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evidence of deterministic 1st order transition patterns* Thus, 
the observation that all the subjects transition patterns devi- 
ated from that calculated from the independence model in the 
direction of more determinism is particularly significant and 
provides some support for the hypothesis of Noton and Srark ( 1 ) 
that visual scanning is characterized by nonrandom repetitive 
sequences of fixations which they called scanpaths • 

Clearly, the way to more explicitly demonstrate these 
patterns is to study situations in which the covert switching 
of information processing strategies can be externalized and 
used to separate the eye movement data corresponding to dif- 
ferent strategies* Indeed, the extent of the deviation of the 
scanning pattern from that expected by statistical independence 
may reflect different information loads on the pilot* Simple 
monitoring may be well modeled by a independence model as used 
above, while more difficult procedure-f ollowing may produce 
more deterministic scanpaths* 
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